ColO-RAN: Developing Machine Learning-based xApps for Open RAN Closed-loop Control on Programmable Experimental Platforms
نویسندگان
چکیده
Cellular networks are undergoing a radical transformation toward disaggregated, fully virtualized, and programmable architectures with increasingly heterogeneous devices applications. In this context, the open architecture standardized by O-RAN Alliance enables algorithmic hardware-independent Radio Access Network (RAN) adaptation through closed-loop control. introduces Machine Learning (ML)-based network control automation algorithms as socalled xApps running on RAN Intelligent Controllers. However, in spite of new opportunities brought about Open RAN, advances ML-based have been slow, mainly because unavailability large-scale datasets experimental testing infrastructure. This slows down development widespread adoption Deep Reinforcement (DRL) agents real networks, delaying progress intelligent autonomous paper, we address these challenges discussing insights practical solutions for design, training, testing, evaluation DRLbased RAN. To end, introduce ColO-RAN, first publicly-available framework software-defined radios-in-the-loop. Building scale computational capabilities Colosseum wireless emulator, ColO-RAN ML research at using components, base stations, ”wireless data factory”. Specifically, design develop three exemplary DRL-based slicing, scheduling online model evaluate their performance cellular 7 softwarized stations 42 users. Finally, showcase portability to different platforms deploying it Arena, an indoor testbed. The lessons learned from implementation extensive results our first-of-its-kind highlight importance frameworks end-toend pipelines, analysis DRL agents. They also provide benefits adaptive control, trade-offs associated training live collected dataset publicly available community.
منابع مشابه
Learning open-loop from closed-loop control
This paper explores an evolution from closed-loop control to open-loop control for a planar manipula-tor. A reinforcement learning strategy is used to learn the open-loop commands from the closed-loop control. The goal is to produce a motion using purely open-loop control strategy, thereby eliminating the need for inter-link communication and on-line control computations. Initially closed loop ...
متن کاملReinforcement Learning for Mixed Open-loop and Closed-loop Control
Closed-loop control relies on sensory feedback that is usually assumed to be free . But if sensing incurs a cost, it may be costeffective to take sequences of actions in open-loop mode. We describe a reinforcement learning algorithm that learns to combine open-loop and closed-loop control when sensing incurs a cost. Although we assume reliable sensors, use of open-loop control means that action...
متن کاملRan
How is Ran involved in nuclear transport? Cargo is transported through pores in the nuclear envelope, in association with carriers that bind to pore proteins called nucleoporins. A Ran–GTP gradient across the envelope is created by the asymmetric distribution of the GTPase activating protein known as RanGAP, which is in the cytosol, and of the guanine nucleotide exchange factor RanGEF in the nu...
متن کاملSmall GTPase Ran and Ran-binding proteins.
Abstract Like many other small GTPases, Ran functions in eukaryotic cells as a molecular switch that cycles between GTP- and GDP-bound forms. Through the proper modulation of the GTP/GDP cycle, Ran functions with a number of Ran-binding proteins to control a broad array of fundamental cellular functions, including nucleocytoplasmic transport, mitotic spindle assembly, and nuclear envelope and n...
متن کاملUser Preference Learning Based Edge Caching for Fog-RAN
In this paper, the edge caching problem in fog radio access networks (F-RAN) is investigated. By maximizing the overall cache hit rate, the edge caching optimization problem is formulated to find the optimal edge caching policy. We consider content popularity in terms of time and space from the perspective of regional users. Taking into account that users request the contents they are intereste...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Mobile Computing
سال: 2022
ISSN: ['2161-9875', '1536-1233', '1558-0660']
DOI: https://doi.org/10.1109/tmc.2022.3188013